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ANALYZING TEXT-BOOKS 



CHARLES H. JUDD 
The University of Chicago 



There is no influence in American schools which does more 
to determine what is taught to pupils than does the text-book. 
Yet this important factor in our educational system has until 
recent years altogether escaped critical study. The text-book 
is, furthermore, removed from institutional control. It is 
produced through the effort and initiative of some individual 
or small group. It is published by a commercial concern 
which i? organized for profit. It is put into the hands of 
teachers who are for the most part so limited in experience and 
training that they never think of questioning the method sug- 
gested by the book and never dream of doubting the validity 
of the educational principles on which the author's selection 
and arrangement of material are based. 

In recent years there has arisen in some quarters a protest 
against the control of text-books by private individuals and 
commercial publishing houses. This protest has resulted in 
California and Kansas in the establishing of a public printing 
plants which print the text-books for the schools. Even in 
these states the material that makes up the books comes as 
before from individual authors. In Kansas the question is 
raised whether the state printer does his work economically. 
The initial investment in the plant was made as a general 
legislative appropriation. Whether interest on this plant 
is a legitimate charge against the books is a matter dicussed 
with more heat than light. 

In both Kansas and California the action of the state 
affects what might be called the purely commercial side of the 
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case. The intellectual problem of providing for a broader 
authorship is in no measure solved. 

In Canada the schools have official texts for which the con- 
tents were compiled by commissions organized under the 
departments of Education of the various provinces. Most 
of the newer provinces have even there taken a short cut by 
adopting the texts prepared by the department of Education 
of Ontario. 

One hears from Canadian teachers objections to the official 
texts. They make for extreme conservatism, it is asserted. 
They are not adapted to some communities as well as to others; 
since they are official and there is no choice, they tend to stifle 
local initiative and experimentation. Experimentation with 
all kinds of new texts is at once a weakness and a strength of 
the method of providing books for the schools of the United 
States. 

There seems little probability that public production of 
books will spread in the United States. At least the expe- 
rience of Kansas, California, and Canada does not seem to 
have made any serious impression on the other states of the 
Union. There is, however, a very widespread growth of state 
control through various systems of adoption. In some states 
there is a rigid official restriction of the local districts to a list 
of books adopted by a state commission. In other states 
there are less definite types of adoption and uniformity. 

The objections commonly offered to state adoptions are 
not unlike those urged in Canada against officially made books. 
It is not the purpose of this paper, however, to discuss the 
arguments for or against wider or narrower units of adoption, 
nor to debate the desirability or undesirability of public 
production of books. There is a view of the whole matter 
which looks far beyond the method of production and brings 
into the field a series of considerations which apply to books, 
whatever their source or method of publication. It is this 
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profounder view which should become familiar to American 
teachers and school officers. 

Every text-book, whatever its source, has characteristics 
which can be accurately tabulated and described. Each book 
has a kind of personality which can be measured no less accu- 
rately than the physical characteristics of a man. Even 
admitting for the moment that there is no possibility of chang- 
ing the method of producing books, it is at least possible to 
cultivate a discriminating attitude on the part of teachers 
which will make the selection of books more intelligent than it 
is at the present time. Scientific studies of books can be made 
and accurate descriptions of their characteristics can be given 
along with the books themselves to anyone who is going to 
use them. 

The fact is that at the present time selection is usually 
wholly unintelligent. The State Department of Minnesota 
in a handbook which it issued for the teachers of that state 
describes the situation in the following paragraph: 

One of the things every teacher has to do is to select one or more text- 
books for the school in which he teaches. The tendency of an inexperienced 
teacher is to take the word of an agent, or to select a book used by a friend 
or used in some school which he admires. The difficulty with such selection 
is that, though the book possess great merit, it may not at all meet the 
needs of the particular school for which it is intended. Again, teachers 
differ so widely in their methods of using a book that what suits one teacher 
does not another.' 

The case as here described is certainly not exaggerated. 
It is because teachers are showing so little wisdom in the 
selection of books that the public has in many states safe- 
guarded the situation by laws removing from the teacher all 
power of choice. The writer recalls a letter from a public 
official responsible for the choice of text-books who was moved 

' Minnesota Course of Study for Elementary Schools and Manual for Teachers. Pre- 
pared by Theda Gildemeister. Published by the State Department of Education, 1916, 
pp. 224. 
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by criticisms made of his selections to a sharp retort. He 
said that there was no justification for criticisms of the state 
selections, that school people were for the most part 
wholly unreliable in their choices. He asserted that it 
was entirely possible to map out the route followed by 
certain book agents through the state by the stream of letters 
recommending certain books that came to the state text-book 
commission. 

Whatever the evils of the present situation, there are 
suggestions of a. way out of the difficulty. Indeed, the book 
companies themselves recognize the necessity of cultivating 
an intelligent system of choosing books. They have in many 
cases made careful analyses of their own books and of the 
books of their competitors and they have set up canons of 
choice on the basis of which to persuade school people of the 
superiority of their books. Miss Perna M. Stine of Sumner, 
Illinois, supplied the writer with some analyses of arithmetics. 
Among other matters described by her are the claims made by 
various publishers. These are of interest as showing the vir- 
tues which the publishers regard as most important. The 
following tables show what publishers A, B, and C say about 
their arithmetics: 



PUBLISHER A 

1. Grounds thoroughly in the fundamentals 

2. Unusually illuminating development work. 

3. Topics interestingly introduced. 

4. Conforms to modern business methods. 

5. Unique system of reviews. 

6. The topical plan used. 

7. Abundant drill. 

8. Carefully graded material. 

9. Mechanically unexcelled. 
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PUBLISHER B 

1. General aims are based on fundamental principles. 

2. The problems are of interest to the child. 

3. The play instinct is appealed to. 

4. Business applications made realistic. 

5. Carefully graded problems. 

6. Abundance of drill. 

PUBLISHER C 

I . Points of elimination. 

1. The problems are practical. 

3. The method of presentation is the best. 

4. The drill is motivated. 

5. The reviews are systematic and frequent. 

Such claims are of interest especially because they suggest 
the possibility of arriving at certain general principles of selec- 
tion on which all intelligent people will agree. 

An attempt to arrive at general reasons for selection has 
been made in several quarters. The Minnesota manual from 
which a paragraph was quoted follows the criticism of the 
ordinary method of choosing texts with a statement of those 
qualities for which teachers should look in readers, arithmetics, 
and other texts. Such a series of desirable qualities is some- 
what less open to the suspicion of being biased than is the list 
of suggestions offered by the agent of a particular book. 
Indeed, in the preparation of such score-cards it would be to 
the advantage of schools if the list of qualities could be made 
by the whole teaching profession. Such a wholly disinterested 
list would then become not only a basis of selection, but also 
a guide to production, for authors would see the necessity of 
conforming to the combined judgment of teachers. 

Score-cards or lists of questions have been prepared by a 
number of school systems. One of the most elaborate sets 
was worked out at Joliet, Illinois, by Superintendent Stoops, 
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who prepared for his teachers score-cards on which they were 
to express their judgment about several kinds of books. These 
score-cards have a double value. - They serve to remind the 
teacher of the characteristics which should be thought of in 
making a selection; and, secondly, as drawn up in this particu- 
lar case, they prescribe a value from each characteristic so 
that the final judgment is weighted, that is, it gives an appro- 
priate emphasis to each characteristic of each book. 

For example, if we take the score-card for spelling books as 
issued by Superintendent Stoops, we find that there are four 
subdivisions of characteristics: the vocabulary, the organiza- 
tion of the material, the aids in developing independent spell- 
ing ability, and the mechanical make-up. These are weighted 
so that out of loo possible points 30 are assigned to vocabulary, 
40 to organization, 20 to aids, and 10 to make-up. Each sub- 
division is worked out in detail. Thus, under vocabulary the 
teacher is asked to consider number of words, the relation of 
the list to the child's vocabulary, provision for enlarging this 
vocabulary and for fitting it to use as determined by modern 
surveys. 

A score-card for each book to be used in the schools is a 
skeleton judgment. If teachers can be trained to study vari- 
ous books with the score-card as a guide, there will result very 
shortly a series of judgments about books which will be more 
detailed and carefully considered than has been common in 
the past. 

Score-cards have another value. They make it possible 
to secure the consensus of many judgments. The city of 
Cincinnati carried on during the year 191 5-1 6 one of the most 
elaborate experiments that has ever been made in securing the 
consensus of opinion of teachers with regard to the best text- 
books to be used in diflFerent departments. In 1915 Superin- 
tendent Condon laid before the Board of Education a plan for 
securing the opinions of teachers. The school system was 
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organized into a series of committees which were to pass on 
books of different grades and subjects. A brief series of ques- 
tions was prepared after these committees had been organized 
referring to the desirable qualities of each of the types of books 
under consideration. The questions with regard to spellers, 
for example, were as follows: 

POINTS TO BE CONSIDERED IN JUDGING THE QUALITY OF 
TEXTS IN SPELLING 

1. The words listed should be those which investigations have shown 
pupils will need most in their written work at school and after they leave 
school. 

2. Provision should be made for frequent review of words commonly 
misspelled. 

3. Words should be listed so as to economize efforts in teaching, i. e., 
grouped as to roots, prefixes, suffixes, etc. 

4. Suggestions to teachers should offer means of presenting words 
with a strong initial appeal, for analyzing difficulties, for discovering types 
of errors, and for following up spelling difficulties in all written work. 

5. Diacritical marks should be used sufficiently to make children self- 
helpful in consulting the dictionary. 

6. Dictation exercises should receive due attention.' 

Various spellers were submitted to each of the members of 
the committees and each one gave his judgment with regard 
to each speller. By a simple method of combining these differ- 
ent judgments the spellers were ranked so that the speller 
receiving the most favorable judgment from the majority of 
the teachers could be clearly indicated. The scientific method 
here used is that which has been employed in a number of 
other matters and may be described as the method of averaging 
judgments. 

In the particular case here under discussion the "ques- 
tions" used as a score-card had the disadvantage of not being 
weighted. It was left to the individual preference of the judge 

' Cyrus D. Mead. The Best Method of Selecting Test-Books. Educational Adminis- 
tration and Supervision. Vol. IV, No. i, February, 1918, pp. 68. 
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to decide whether question 5 is more or less important than 4 
or 6. This introduces an element of variability into the judg- 
ment that is eliminated when the questions are weighted. On 
the other hand, an unweighted score-card has the advantage 
of giving each teacher the opportunity to contribute his or her 
personal experience in deciding what is important and what 
is not. 

The methods of selecting books discussed up to this point 
are all based on the assumption that the teacher is prepared 
to judge of the desirability or otherwise of this or that char- 
acteristic. For example, in the Joliet score-card for spellers 
the question is raised, does the vocabulary tally with the child's 
vocabulary? The teacher is supposed to be able to supply the 
answer. The fact is that the judgment of teachers in such a 
matter will differ widely. This is proof enough that not all 
of the judgments can be equally valid. 

Experience leads us to demand, therefore, some kind of 
analysis of books which will clarify the teacher's judgment. 
The text-book must be analyzed by some impersonal method 
in order to prepare the way for the teacher's judgment. 

Some beginnings have been made along these lines. If 
we examine one or two such efforts, we shall see the respects 
in which they are superior to the method of mere judgment and 
we shall at the same time discover how difficult it is to sepa- 
rate the facts about books from judgments based on personal 
attitudes. 

A few years ago, Mr. Whitney, then in Minneapolis, 
compared nine first readers with reference to various char- 
acteristics, first with regard to the total number of different 
words which they contain. He found one book with 211 
different words, another with 295, a third with 483, and 
so on up to the ninth, which had 1,047. So far his facts 
are perfectly objective. Mr. Whitney's comment on his table 
is as follows: 
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In this study, then, it was thought that the book which presented the 
smallest number of words to be fixed as a reading vocabulary during the first 
year of school, was the most valuable book from that standpoint. Of course, 
this must be a reasonable number. The accompanying table gives the 
total number of different words in each book, and it will be noticed that 
Book A has a total of 211. If this number of words be dealt with during 
the first year, it will mean that a little more than one word will be pre- 
sented each day of the year. It was thought that this was all that could 
be reasonably asked and that attempting anything more under ordinary 
first grade conditions would result in something less than habit formation 
in word getting. For this reason. Book A is ranked first on this basis, 
and Book I, which has 1,047 words, is ranked ninth." 

The comment is evidently not of the same value to all 
teachers as the count of words. One might dissent from 
Mr. Whitney's attitude wholly and yet be able to use his find- 
ings with regard to the number of words. 

This example makes it clear that the study of text-books 
will inevitably lead teachers to a consideration of important 
problems of the course of study. Indeed, there is no better 
way of training teachers to see the importance of certain 
general problems of the course of study than through an analy- 
sis of text-books. 

For example, let us take up a study of geography text-books 
and see what light they throw on the course of study in that 
subject. Mr. G. W. Warner of Decatur, Indiana, supplied the 
writer with interesting information about two geographies of 
a widely used series. He compared the two books, used respec- 
tively in the upper and the lower grades, with reference to the 
amount of repetition of ideas which their use is likely to impose 
on the pupils. The method of Mr. Warner's investigation was to 
take every tenth section of the book used in the lower grades, 
to count the ideas contained in each selected section, and then 
to look for repetitions of these ideas in the book placed in the 
hands of the upper grades. 

' Frederick L. Whitney. Measuring the Value of First Grade Readers. School 
Board Journal, September, 1916. 
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The results of this inquiry are given in Table I : 

TABLE I 



Book One 


Book Two 




Number of Ideas 
Repeated 


Section Number 


Number of Ideas 


lO 


12 


I 


20 


6 


4 


3° 


7 


S 


40 


9 


5 


50 


10 





6o 


9 


3 


70 


14 


12 


80 


7 





90 


22 


IS 


100 


6 


6 


no 


4 


2 


120 


3 


2 


130 


2 


I 


140 


14 


14 


150 


23 


15 


160 


7 


7 


170 


7 


4 


180 


4 


2 


190 


31 


23 


200 


12 


8 


210 


9 


7 


220 


9 


7 


230 


II 


II 


240 


II 


6 


250 


9 


6 


260 


22 


12 


270 


20 


IS 


280 


7 


4 


290 


8 


4 


300 


13 


7 


Total 


328 


208 



The repetitions here tabulated are not mere duplications 
of ideas, but in many cases are exact repetitions of phraseology. 
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The matter may be pushed further. In the lower books 
there are thirty-four large maps. Sixteen are exactly dupli- 
cated in the book for the higher grades and eleven others are 
different merely in the addition of a few minor details. Again, 
if the topics and subtopics in the two books are compared, it 
is found that 80 per cent of the subtopics treated in the lower 
book are repeated in the upper book. 

Most users of these books are not aware of the amount 
of this repetition, because they do not compare the books. 
The teacher in the seventh grade sees only one book; the 
teacher in the fourth grade sees only the other. Both may 
be aware in a general way that there is repetition, but this is 
thought of as justifiable review. The fact is that teachers are 
often tolerant of reviews in the upper grades. But such an 
analysis of text-books should shock even the most conservative 
review-loving upper-grade teacher because of the exhibition 
which it gives of the amount of reviewing tolerated. 

Here again we find ourselves led by a study of text-books 
to one of the most important problems of the course of study. 
Again and again it has been pointed out in reports of commit- 
tees and discussions at educational meetings that there must 
be greater attention to economy in organizing the work of the 
schools. Needless repetitions must be eliminated. Evi- 
dently analysis of text-books will help in the reforms which are 
coming in the interests of economy. 

Enough has been said in the foregoing paragraphs to justify 
the announcement that this Journal will undertake in forth- 
coming numbers a series of discussions of the text-books used 
in American schools. There is a purely mechanical side to 
text-book making which is very little understood by the ordi- 
nary user of a book. The putting of a book through the press 
involves an amount of labor understood only by those who go 
through the operation. This mechanical side of the matter ought 
to be understood by those who are to make intelligent choices. 
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There is a complex series of relations between the author 
and the publisher which can never be overlooked when one is 
listing the influences which contribute to the course of study. 
The fact is that an intelligent publisher can do much to pro- 
mote the development of educational methods. It is unfortu- 
nately true in equal degree that a publisher who is willing to do 
so can block the progress of educational movements. 

The printer, the publisher, the author, the member of the 
state commission, and all others who contribute to the making 
and selection of text-books are agencies of major importance 
to schools. This series of articles will aim to bring out as fully 
as possible the importance of each by concrete examples of the 
way in which each contributes to the situation as we find it in 
the schools. 

The chief purpose of the articles will be to induce as widely 
as possible a discriminating study of books. If teachers* 
associations would substitute reports on text-books by their 
own members for speeches by outsiders, there would be large 
gain both financially and intellectually. These committees 
could gather up the most valuable body of practical criticisms 
and could match this practical material with scientific analyses 
of the contents of the books which would stimulate the most 
productive thinking. 

Without waiting for larger groups to move in the matter, 
the teachers in a single school building or in a town could have 
very profitable meetings discussing in detail the characteristics 
of the books which they use in their class work. 

Even the individual teacher ought to make some such 
studies. Without any idea of changing the text now in use 
in a given grade, it is desirable that the virtues and defects of 
the book should be brought out by careful analysis and com- 
parison with others of its class. 

In short, the study of text-books should become a regular 
part of the duty of every school officer. 



